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Abstract — In this paper we assess the impact of path reser- 
vation as an additional feature in our distributed real-time 
vehicle guidance protocol BeeJamA. Through our microscopic 
simulations we show that naive reservation of links without any 
further measurements is only an improvement in case of complete 
market penetration, otherwise it even reduces the performance 
of our approach based on real-time link loads. Moreover, we 
modified the reservation process to incorporate current travel 
times and show that this improves the results in our simulations 
when at least 40% market penetration is possible. 

Index Terms — vehicle route guidance, distributed system, 
swarm intelligence 

I, Introduction 

It is widely acknowledged that traffic congestions in urban 
road networks have enormous negative impacts with respect 
to economical as well as ecological aspects UJ. Hence, there 
has been extensive research in the field of traffic flow opti- 
mization [2] and (on-line) vehicle guidance recently. In @ 
we proposed a distributed, swarm intelligence-based vehicle 
guidance approach termed BeeJamA. In contrast to state- 
of-the-art commercially available systems, based on central- 
ized shortest path algorithms, distributed routing protocols 
in general have potentially a higher scalability in terms of 
road segment (link) load update frequency and covered area. 
The BeeJamA approach borrows from the foraging behavior 
of honey bees and utilizes a multi-layer hierarichal concept 
to disseminate routing relevant link load information every 
second but in a limited vicinity only, similar to the scout- 
forager behavior of its natural counterpart. 

In [4 1, (5j two distributed ant-based vehicle guidance ap- 
proaches have been described. The latter also includes a dy- 
namic path reservation approach, however, it is only evaluated 
with a complete, or 100%, (market) penetration. Obviously, 
this is a factious assumption as different vehicle guidance 
concepts are and will be used in realistic environments. As 
the contribution of this paper, we add distributed path reser- 
vation to our BeeJamA approach and evaluate the resulting 
protocol under varying penetration rates on a complex road 
network with a microscopic traffic simulator. We will show 
that a simple and naive link reservation even decreases the 
protocol's performance with respect to average travel times if 
the penetration is not complete. Additionally, we combine the 
strength of the BeeJamA protocol, fast link load updates, with 
path reservations and show that this hybrid approach performs 
better than the naive one. In our simulations reservations 
increase the performance of BeeJamA if the penetration is 
at least 40%. 



The remainder of this paper is structured as follows. In the 
next section, the basic path reservation concept is described. 



In Sec. Ill the plain BeeJamA protocol is briefly explained 
and the additional reservation procedure is introduced. Sec. IV 
presents the simulation setup as well as the simulation results. 
Finally, we conclude the findings in Sec. [V] 

II. Path Reservation 
Path reservation refers to the registration of vehicles' ex- 
pected arrival times on the links of their anticipated path. In 
subsequent guidance decisions these link reservations can be 
incorporated to help predicting future link loads. The plain 
BeeJamA protocol so far intentionally avoids incorporating 
any kind of traffic load prediction, but tries to offer routing 
recommendations based on up-to-date traffic information be- 
fore each intersection in due time. Path reservation, however, 
requires some temporal lookahead, since the link travel time 
(the link weight from the perspective of routing protocols) 
depends on the number of reservations. Hence, one must infer 
from the number of reservations of a link the expected travel 
time. The basic tools to express this relation are empirical 
density / travel time diagrams or formal link performance 
functions (LPF). Empirical density / travel time relationships 
may be learned offline or online by means of machine learning 
techniques like artificial neural networks. LPFs are equations 
typically derived from empirical findings as the well known 
BPR function (Bureau of Public Roads, superseded by the Fed- 
eral Highway Administration of the United States Department 
of Transportation, cf. [6|), given by: 



t e (f & )=t°Jl + a(^\' 



(1) 



where t e (f e ) is the resulting travel time for flow f e attempting 
to use link e, when the free flow travel time is t° e and c e the 
capacity (in vehicles per hour) the link has been design for. 
Different values of a and f3 are used to adjust the function to 
different road types and can be found in [6|. 

We derived a LPF under the assumption of equidistant 
headways of the queue-based macroscopic MATSim traffic 
simulator we used in our simulations from the source code and 
checked it empirically in a simple test setup where a single 
link is on the only path from source to destination for all 
vehicles. The function is given by: 
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Fig. 1 : Link performance function 



Fig. 2: Positive effect of reservation on travel time distribution 



where c e is maximum capacity of the link e, a value the 
simulator computes on startup from static properties of a 
link like type and number of lanes of the road. In general, 
the headways must not be not equidistant, thus a pile-up in 
the incoming queue of a link occurs and the second case 
(fe > Ce) describes the travel time by its own. Fig. [T] depicts 
the MATSim LPF as well as three BPR instances (with 
a = 0.15,13 = 4 (default), a = 0.88, /3 = 9.8 (highway), 
a = 1, /3 = 5.4 (multilane), cf. (6) for more details). 

Essentially, path reservation then works as follows. With 
each link a reservation log is associated, which consists of 
slots (in this paper with a length of 1 minute). Now suppose 
a vehicle v is currently at node no at time to and a path 
of nodes (ii ,ji 1 ,...,ji m ) is calculated, where n m is the 
vehicle's destination. First, the expected travel time to,i°f link 
(no, Hi) is calculated using the link's LPF. Then, the vehicle 
is registered at the link, i.e. each reservation slot for the 
link in the interval [<o,*o,i] is incremented and the process 
is repeated with link (rii,n2) until the last link is reached. 
Thus, subsequent path calculations of other vehicles respect 
the path choice of v, since the former registrations lead to 
higher LPF values. If a vehicle re-calculates a path during its 
travel, it has to update its previous path reservation, i.e. it 
removes, advances or postpones the link reservations made so 
far and/or adds reservations on other links depending on the 
newly calculated path to reflect changes. 

Fig. [2] may serve as a general motivation for the idea of 
reserving links on a path. There, we compared a dynamic 
version of centralized shortest path routing protocol with 
(DynResSP) and without (DynSP) path reservation, that has 
access to refreshed averaged travel times over the links of the 
network every ten minutes. In contrast to the non-reserving 
version, the DynResSP protocol reserves each time a new 
path is calculated (in other words each lOmin at earliest) 
the changed path, i.e. the link is annotated such that it is 
added when the reserving vehicle will arrive at the beginning 
of the link and how long it will likely stay on the link. 



(Detailed elucidations of the simulation setup can be found in 
Sec. [IV]) The average travel time dropped from about lOOmin 
to 42min. As one can see from the boxplots of the travel 
time distribution, the lower, medium and upper quartile are 
considerably better with path reservation, although there are 
a lot of outliers in case of the path reservation protocol and 
the maximum values do not differ as desirable. Additionally, 
the penetration is 100% and such perfect conditions cannot be 
achieved in realistic environments. However, this simplistic 
setup makes clear that path reservation may have enormous 
potential to reduce travel times. 

III. The BeeJamA Protocol 

The BeeJamA vehicle guidance approach is a distributed 
routing protocol based on swarm intelligence and is opti- 
mized to disseminate least cost path information in large road 
networks as fast as possible. A comprehensive description 
of the protocol and additional literature references can be 
found in (3). The following sections outline the basic ideas 
of BeeJamA, which are then extended by path reservation. 

A. Basic Concepts 

BeeJamA is a distance vector protocol and continuously 
floods bee agents from each node through the network in the 
opposite direction of traffic, so-called upstream scouts, (see 
Fig. |3ja)). Once a node in the network receives a scout, it 
updates its routing table and floods the agent once again to 
all predecessors (except the node the bee arrived from). On 
their travel a scout accumulates the travel time from the links 
and hence disseminates the cumulated travel time upstream 
through the network until the hop limit of a scout is reached. 
A scout's hop limit depends on the hierarchy level of its origin 
node. An hierarchy of overlapping zones is established by 
means of a leader election protocol that creates clusters of 
adjacent nodes and assigns (at least one) leader node as cluster 
representative per cluster. The leaders may start a new leader 
election process among them and thereby create cluster on a 
higher logical layer level. The highest layer (with the clusters 



of largest extent) floods bees with infinite hop limit, lower 
layers have finite and decreasing hop limits (depending on 
the configuration which is a tradeoff between accuracy and 
communication overhead). As a result, it is finally guaranteed 
that at each node at least one routing table entry leads to at 
least one cluster representative the destination node is part 
of. Then, vehicles are always forwarded on the current least 
cost path to cluster representative of the lowest layer of which 
scouts have arrived so far at the current node. Finally, the 
last cluster is the one-element cluster of the destination node 
itself. The protocol is based on a vehicle-to-infrastructure 
(V2I) architecture, where so-called navigators act in lieu of the 
nodes and links in their limited area of influence. These areas 
are a node partition of the road network and the navigators 
maintain routing tables for each of these nodes as well as 
handle the outgoing and incoming bee agents. 

B. Integration of Path Reservation in BeeJamA 

The basic idea to implement path reservation in BeeJamA is 
that the upstream scouts additionally disseminate the predicted 
future travel times. Unfortunately, an upstream scout does 
not know when vehicles (moving downstream) will arrive at 
the node the upstream scout currently passes. Thus, it is not 
known for which time in future the LPF should be evaluated. 
To circumvent this problem, we introduce downstream scouts 
which traverse links in the original direction of traffic flow and 
work otherwise as their upstream counterparts: cumulating the 
travel time and updating tables. However, these table entries 
are not used to forward vehicles but to tell the upstream 
scouts how long a vehicle currently would need to travel from 
the downstream scout's origin to the current node. Fig. |3?b) 
illustrates this concept. There, node a floods a downstream 
agent and a situation of the asynchronous process is depicted, 
where the scout on the left (and least cost) path to e has already 
reached e (suppose that is the vehicle's destination). Therefore, 
node e has learned that a vehicle starting now at a would need 
8 minutes to arrive at e. The next generation of upstream scouts 
starting at e can now evaluate the LPF for the correct time, i.e. 
in 5min from now on at node d for link (d, e) (see Fig. (3lc)). 

The next necessary difference compared to the plain Bee- 
JamA protocol is the use of foragers, which are used to 
increment the number of registered vehicles on a link (see 
Fig. [3jd)). This agent is called a forager, since it announces a 
consumption of available resources, as a forager bee in reality 
reduces the amount of available nectar. After the navigator 
selected the next hop for the requesting vehicle, a forager is 
emitted on the link towards the selected next hop on the least 
cost path, i.e. node b in the example. After arriving there, the 
same navigators computes the next hop for the forager as if 
it was a vehicle and forwards the agent accordingly. Thus, 
the forager agent traverses the same path immediately (only 
delayed by the transmission in the communication network), 
the slower vehicle would take later if the least cost path does 
not change in the meantime. When the forager arrives at the 
destination, the whole path is transmitted back to the vehicle. 
Subsequent foragers started for this vehicle would possibly 



result in different paths due to road network load changes, 
which the vehicle could test for equality and de-register at 
previously chosen links if the path changed. 

By virtue of this approach, a completely distributed and dy- 
namic path reservation protocol emerges. The main drawback 
of this simple and naive approach (ResBeeJamA-N) is that link 
travel time is solely derived from the reservations on a link. In 
case of 100% penetration this may be and, as the simulation 
results show, is beneficial in terms of average travel times. For 
the common situation with incomplete penetration of a single 
approach, better ways to predict the expected travel time must 
be used. There exist a lot of approaches for short and long time 
traffic forecasting [7| often requiring expensive computation 
or long learning phases, though. Neither is advantageous in 
highly dynamic traffic situations, which is why we present a 
simple hybrid technique of incorporating a LPF and the current 
mean travel time in the next section. 

C. Hybrid Path Reservation 

Our dynamic hybrid approach (ResBeeJamA-DH) evaluates 
the prediction precision per link and weights the link per- 
formance prediction and current load accordingly. The better 
the prediction over time is, the higher is the impact of the 
link performance function. The basic notion of this approach 
is a simple heuristical rule of thumb: if the prediction for 
a link in the past was precise, the predictions in the future 
will be precise as well. To assess the past prediction accuracy 
we compare the difference of past predictions and actual 
observed travel time on a link. Formally, we apply a regression 
analysis technique, the Pearson correlation coefficient. Thus, 
a correlation of time (last hour) and the prediction error 
(difference of actual and predicted travel time in the last hour) 
is calculated and serves as a basis for weighting the ratio of 
the LPF and the current mean travel time. 

The Pearson product-moment correlation coefficient for 
random variables X, Y is defined as 



PX,Y 



cov{X,Y) 
axo-y 



(3) 



where cov(X, Y) denotes the covariance of X and Y and 
<tx , o~y the variances of X and Y, respectively. Using mea- 
sures xi, . . . ,x n and t/i , . . . , y n the empirical version of Eq. [3] 

is: 






(4) 



where x,y are the sample means. During the simulation we 
take every minute, at time i, an observation of the current 
mean travel time t" ir as experienced by the vehicles on each 
link e and calculate as well a prediction £®**. according the 
current reservations on e. The prediction error err is then 
simply denoted by the difference err e - 1 — t%£ r — fi, The 
sample Xi expresses the time of an observation relative to 
the beginning of the current observation time window (at 
least one minute, {x\ = 1} and one hour at a maximum 
{x\ = 1, . . . , £60 = 60}). Obviously, these samples are always 
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Fig. 3: BeeJamA agents' concepts 
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Fig. 4: Interpretation of prediction error correlation 



positive correlation r will be found and vice versa. In case 
of an increasing error on the link, we conclude that the 
predictions are less reliable and the current travel time may 
be a better estimation of future travel times (cf. Fig. HI. We 
express this intuition by 
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IV. Simulation studies 



(5) 



strictly increasing, i.e. X{ < Xi+\. The sample y, is then The guidance protocols has been evaluated using the MAT- 
the corresponding prediction error. If the prediction error is Sim microscopic traffic simulator on a road network extracted 
increasing over time (and there is a linear dependence), a from Open Street Map. It is a part of the German Ruhr District 




Fig. 5: Ruhr District 
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Fig. 6: BeeJamA vs. ResBeeJamA-N 



(see Fig. pi) with a size of about 40 x 20fcm~ 
network exhibits 5616 nodes and 10185 links. Throughout all 
simulations an identical setup of the same 300.000 vehicles is 
reused, where in each of the first five simulation hours 60.000 
vehicles start. 

We compared two routing protocols: a dynamic centralized 
shortest path protocol (DynSP) and our own distributed real- 
time protocol BeeJamA. The DynSP protocol is powered by a 
dynamic version of the A* algorithm, i.e. the link weights are 
updated regularly and the vehicle recalculates the least cost 
path with the same frequency during its travel. For example 
if a DynSP 30min protocol is deployed, every 30min the 
link weights as estimated by the current mean travel time is 
refreshed. Moreover, all vehicles guided by a DynSP 30min 
protocol, requests an initial route and afterwards each 30min. 
In the best case a vehicle recalculates its least cost path right 
after the link weights were updated, in the worst case the 
link weights are nearly 30min old and thus maybe outdated. 
The reserving modifications of these protocols are denoted 
as DynResSP and ResBeeJamA and a reserve slot length of 
lmin is used. The BeeJamA protocol floods each second a 
generation of scouts, the areas are obtained by a grid partition 
(with a box side length of 1500m). 

In the following simulation studies we will also evaluate 
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Fig. 7: Comparison for a 50% penetration rate 
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Fig. 8: BeeJamA vs. ResBeeJamA-DH 



the influence of the protocol's penetration, i.e. the (market) 
share of a given protocol. In this paper, remaining vehicles 
are guided by a DynSP 30min protocol. For example, if 
ResBeeJamA has a penetration of 30%, 90.000 vehicles are 
guided by ResBeeJamA and the remaining 210.000 vehicles 
by DynSP 30min. 

In Sec. Ill] the Fig. E] was used to motivate the concept 
of reservation. With the above elucidations, the boxplots 
belong to the travel time distributions of a DynSP lOmin 
and DynResSP lOmin, respectively. As stated in Sec. [II] it 
is obvious that in this example reservation is beneficial. Next, 
we will evaluate if BeeJamA as a real-time protocol could gain 
an improvement through reservation. 

Fig. [6] depicts the average travel time with an increasing 
penetration of BeeJamA and ResBeeJamA-N. Obviously, the 
naive reservation is not able to improve the performance of 
BeeJamA, except for the unlikely situation of a complete 
penetration, where the average travel time dropped from 
29.17min to 27.68min (see Tab. |I]for details). Next, in Fig. 17] 
the cumulative number of arrived vehicles over time under 



TABLE I: BeeJamA travel times (in minutes) 
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Fig. 9: 30% penetration: BeeJamA vs. ResBeeJamA-DH 
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Fig. 10: 90% penetration: BeeJamA vs. ResBeeJamA-DH 



different kinds of BeeJamA for a penetration of 50% is shown. 
Beside ResBeeJamA-N and -DH, we also evaluated a simple 
static approach (-S), where the weight of the current and LPF 
travel time is proportional to the penetration rate, i.e. for the 
50% case, the link weight is 2 x ti p f. The intuitive notion of 
this weighting is that under a normal distribution assumption, 
the number of vehicles actually on a link is twice the registered 
vehicles if the penetration is 50%. 

The naive path reservation as well as the static version per- 
forms worse, it takes roughly 700min for all vehicles to arrive 
compared to about 450min for the plain BeeJamA and the 
ResBeeJamA-DH protocol. Interestingly, the DH reservation 
is even slightly better and hence we focused in the following 
simulations on this variant. Fig. IS] shows the average travel 
time over time for the BeeJamA and ResBeeJamA-DH. Even 
though, both curves are similar, with at least 40% penetration 
the path reservation promises benefits for this certain simula- 
tion setup. Fig.|9]and Fig. 10 depict the cumulative number of 
arrived vehicles broken down by (Res)BeeJamA and DynSP 
protocol for a penetration of 30% and 90%, respectively. Once 



again both protocols behave similar, however, in the case of 
the lower penetration the plain BeeJamA protocol performs 
better (resulting in a remarkable difference in the mean travel 
time of about 8min) and vice versa in the other case (with a 
difference of about 3min in favour of path reservation). 

V. Conclusion 

We presented a thorough simulative analysis of a distributed, 
on-line vehicle guidance protocol with a path reservation 
extension under varying penetrations. We showed that a naive 
implementation, where the reservations are the only source 
to predict future travel times, does not improve the results 
in terms of average travel times of our BeeJamA protocol, 
except in the unlikely case of a 100% penetration. A hybrid 
implementation where the current mean travel time over links 
are incorporated additionally improved the results significantly, 
though. In future work, will extend the proposed approach to 
include marginal cost pricing strategies. 
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